Hierarchical Markov State Model Building to Describe Molecular Processes
نویسندگان
چکیده
منابع مشابه
Hierarchical Solution of Large Markov Decision Processes
This paper presents an algorithm for finding approximately optimal policies in very large Markov decision processes by constructing a hierarchical model and then solving it. This strategy sacrifices optimality for the ability to address a large class of very large problems. Our algorithm works efficiently on enumerated-states and factored MDPs by constructing a hierarchical structure that is no...
متن کاملApplication of Markov Processes to the Machine Delays Analysis
Production and non-productive equipment and personnel delays are a critical element of any production system. The frequency and length of delays impact heavily on the production and economic efficiency of these systems. Machining processes in wood industry are particularly vulnerable to productive and non-productive delays. Whereas, traditional manufacturing industries usually operate on homoge...
متن کاملComposing Nested Web Processes Using Hierarchical Semi-Markov Decision Processes
Many methods proposed for automated composition of Web processes use classical AI planning approaches such as rulebased planning, PDDL, and HTN planning. Web processes generated by classical planning methods suffer from the assumption of deterministic behavior of Web services and do not take into account fundamental QoS issues like service reliability and response time. In this paper, we propos...
متن کاملA Hierarchical Markov Model to Understand the Behaviour of Agents in Business Processes
Process mining techniques are able to discover process models from event logs but there is a gap between the low-level nature of events and the high-level abstraction of business activities. In this work we present a hierarchical Markov model together with mining techniques to discover the relationship between low-level events and a high-level description of the business process. This can be us...
متن کاملHierarchical Control and Learning for Markov Decision Processes Abstract Hierarchical Control and Learning for Markov Decision Processes
This dissertation investigates the use of hierarchy and problem decomposition as a means of solving large, stochastic, sequential decision problems. These problems are framed as Markov decision problems (MDPs). The new technical content of this dissertation begins with a discussion of the concept of temporal abstraction. Temporal abstraction is shown to be equivalent to the transformation of a ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Journal of Chemical Theory and Computation
سال: 2020
ISSN: 1549-9618,1549-9626
DOI: 10.1021/acs.jctc.9b00955